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Abstract: New theoretical results are presented here on the recently intro- 
duced model called mixed states MRF. Such models were introduced in the 
context of image motion analysis and are useful to represent information which 
can take both discrete values accounting for symbolic states, and real values cor- 
responding to continuous measurements. In particular, results are given when 
the global energy for the Gibbs formulation expressing the mixed states model, 
can be decomposed into one term accounting for the discrete part of the model, 
and a second term related to the continuous part. This decomposition theorem 
permits to define conditional mixed states models in a very simple way. 
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Champs de Markov aleatoires a etats mixtes 
avec etiquettes symboliques et valeurs 
multi-dimensionnelles reelles 

Resume : De nouveaux resultats theoriques sont presentes ici sur le modele 
recemment introduit appele Champs de Markov Aleatoires a Etats Mixtes. Ces 
modeles ont ete introduits dans le contexte de I'analyse du mouvemcnt dans 
des sequences d'images, et sont utiles pour representer I'information qui peut 
prendre des valeurs discretes correspondant a des etats symboliques, et des va- 
leurs rccUcs correspondant a des mesures continues. En particulier, des resultats 
sont donnes quand I'energie globale pour la formulation de Gibbs, exprimant le 
modele a etats mixtes, peut etre decomposee en une partie discrete et une par- 
tic continue. Cettc decomposition permet de definir les modeles conditionnels 
a etats mixtes d'une manicrc trcs simple. 

Mots-cles : Analyse de mouvement en images, champs de Markov aleatoires, 
etats mixtes. 
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1 Introduction 

Usually in statistics one is either interested in random variables that are discrete 
in nature, (dices, card games, photon counting, nuclear decay, etc), or that 
are continuous, meaning that its distribution function is absolutely continuous, 
and hence they have a probability density function defined as the derivative of 
the distribution function, as is the case, for example, of the Gaussian random 
variables. In some situations, one may be interested in modeling a variable that 
may take some discrete values in a set with non-zero probability mass, while for 
the other values not in the given set, the random variable may be modeled as a 
continuous distribution. Examples, might be the daily rainfall, for which 
there are days with no rain with non zero probability, while for the rainy days 
a continuous distribution random variable might be appropriate. In quantum 
mechanics one is faced with such situations, as for example in solid state-physics 
when one considers the solution of the band model for semiconductors. Another 
example arises in the field of reliability when modeling the mean life time of some 
component, for which there is a non zero mass probability of failure at time zero, 
while for time greater than zero an absolutely continuous distribution might be 
appropriate. In particular, these models appear to be of interest in low level 
modeling of motion in image processing. In previous work, [2], [7], [5], [T7], [IS] . 
[I9] . [20] , [21], [25], it has been found that when modeling motion in complex 
images, as for example a video sequence showing public in a stadium, or a scene 
of a tree waving under the wind, among other examples, the histogram of the 
velocity vectors at each pixel show a large probability mass at zero velocity, 
while the second component of the mixture may be appropriately modeled with 
a Gaussian distribution in many situations. 

These examples suggest the introduction of mixed states random variables, 
[2] I [3 J [S]i EI]- That is, variables that have mass probability concentrated in 
isolated points, while they have a probability density for the rest of the real line. 

Image motion analysis involves challenging issues such as motion detection, 
segmentation, estimation, recognition or classification, [3] , [22] , [24] . In this con- 
text, compact and efficient representations of image motion are needed. Digital 
information present in or extracted from images may be expressed as numerical 
values or discrete values (i.e., abstract labels). Moreover, these two types of 
variables may more deeply reflect two different classes of information: contin- 
uous real values (either in one-dimensional or multi-dimensional spaces) versus 
symbolic values (one or several symbols). However, these two classes should not 
be necessarily viewed as two exclusive states or as consecutive states (e.g., after 
a decision step). Indeed, a physical variable can take both continuous and dis- 
crete values, namely it can be a mixed states variable. To give a simple example 
related to image motion analysis, a locally computed motion quantity can be ei- 
ther null or not. Then, it can be helpful to explicitly consider that it takes either 
a discrete value expressing the absence of motion, or that continuous real values 
account for the actual measurements. A discrete value may not necessarily be a 
specific real value, it may also be taken as a pure symbolic value as well. As an 
example, when considering optical flow, the label could be related to the pres- 
ence of motion discontinuities while the corresponding continuous values are the 
velocity vectors. Evaluating the distribution of measured values, and accounting 
for local context, are of key importance in numerous image sequence analysis 
tasks (e.g. in motion modeling, detection, segmentation, estimation, recogni- 
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tion, or learning issues). Therefore, defining probabilistic mixed states models 
appears as an attractive objective. Markov Random Fields (MRF) are widely 
used in image analysis, [4]. Recently, the so called mixed states auto- models 
were introduced, [5], (i.e., MRF models with two-site cliques), as a generaliza- 
tion of the models studied in [T]. These models were used for modeling and 
segmenting motion textures with convincing experimental results, [S]. 

New theoretical results, in the form of Gibbs potentials, allow to significantly 
extend the power expression and the effective and flexible use of these models, 
that may open new investigation avenues in image motion analysis tasks. 

The contributions presented here are made along the following lines: 

1. A detailed measure theoretic formulation of the mixed states random vari- 
ables is given. 

2. The cases in which the probability mass is concentrated either in discrete 
real values and/or in symbolic labels is thoroughly analyzed. 

3. A full account is given for Markov Random Fields of mixed states random 
variables corresponding to a mixture of a probability mass in a known real 
value, and an absolutely continuous distributed real random variable as 
second component of the mixture, when there is no interaction between 
the potentials of the discrete and the absolutely continuous components 
of the Gibbs representation. 

4. The generalized Markov Random Fields presented here are of general form 
in the sense that no stationarity assumption is assumed, moreover, at each 
of the sites the corresponding random variables may take values in different 
spaces. 

5. The theoretical approach introduced here permits to analyze mixed states 
Markov Random Fields for any clique size, hence extending the previous 
results given in j2] , [H] , [l2] , [21] , which are only valid for random variables 
belonging to the exponential family and up to cliques of size two. 

2 Mixed States Random Variables 
2.1 Preliminaries 

ft is well known that the distribution function of a random variable taking one- 
dimensional real values may be decomposed in the convex combination of three 
parts: a discrete part, an absolutely continuous part, and a singular continuous 
part, all with respect to the Lebesgue measure. The random variables considered 
here have as distribution function a convex combination of a discrete and an ab- 
solutely continuous (with respect to Lebesgue measure) distribution functions. 
These distribution functions do not have a probability density function with re- 
spect to the Lebesgue measure, but they are absolutely continuous with respect 
to a measure which is the sum of the unit mass probability at the discrete points 
plus the Lebesgue measure over the real line. Call the corresponding Radon- 
Nikodym derivative a "mixed states probability density function (ms-pdf)" and 
the corresponding random variable, a "mixed states random variable". This 
idea permits to immediately consider random variables on more general spaces. 
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In particular, as previously discussed, it is of interest to study random variables 
that take values either in a countable set of labels L with probability < p < 1, 
or in R" with probability 1 — p. That is, given a probability space (51, it 
is of interest to analyze random variables of the form X : — > L U R". 

The following convention is used for upper scripts of probability related func- 
tions: the upper script will correspond to mixed states related formulations, 
the upper script will correspond to discrete states formulations, while ° will 
correspond to formulations related to absolute continuity with respect to the 
Lebesgue measure. 

2.2 Distribution function for one dimensional real random 
variables 

Let's start with a brief review of distribution functions for one dimensional real 
random variables. 

The following results may be found in any standard text on probability 
theory such as as well as any standard text on measure theory such as [10] 
or [13|. 

Consider a finite measure space (f2, where $7 is some abstract space, 

is a (T-algebra of subsets of and is a finite measure for the measurable 
space (fl,J-). A probability space is a finite measure space with ^{fl) = 1. 

Call N the set of non-negative integers. Call R the set of the real numbers, 
and call 3§ the Borel cr-algebra of subsets of R, i. e. the minimal cr-algebra 
generated, say, by the open subsets of R. 

A real finite-valued random variable AT is a function from il to the real 
numbers R, such that the inverse image of any Borel set i? G ^ belongs to 
i. e. A-i(B) G VB e ^. 

Let's introduce the measure for the measurable space (R, ^) as: for 
every subset B G ^ define nx{B) = 0^{X^^{B)). The measure is called the 
measure inducedhy the random variable A, see theorem 3.1.3, [5]. Alternatively 
^(A-i(-B)) is also denoted as ^(A e B), so that nx{B) = ^{X-\B)) = 
^{X G B). Hence (R,^, px) is a measure space, and as a matter of fact it is 
a probability space since Aix(IR) = ^(^-^(R)) = ^(A G R) = ^(fl) = 1. 

Define the distribution function of the random variable A as Fx{x) — 
^{X G {-oo,x]) = ^{X < x). Note that some authors, e. g. [16], define 
the distribution function as the probability of the inverse image of the open set 
(oo, x), i. c. Fx{x) = iP{X < x), instead of the set (— oo,x] as done here, 
following [5]. 

The distribution function obtained is a non-decreasing function, with: 

lim Fx{x) = 0, 
lim Fx{x) = 1, 

X — ' + 00 

which is continuous on the right at each x G R, and has a limit on the left at 
each a: G R. As for the last property, if the distribution function is defined as 
in |16j . the function is continuous on the left at each a; G R, and has a limit on 
the right at each a; G R. Again, the definitions in [Sj are used here. Conversely, 
any function satisfying the preceding properties, is the distribution function of 
some random variable. 
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An additional most important property for what follows, is that the set 
of discontinuities of the distribution function, being an increasing function, is 
countable. 

A distribution function that is continuous everywhere is called a continuous 
distribution function. 

Define Ut{x) as the step function w : IR — > R, for which Ut{x) — if x < t, 
and Ut{x) = 1 if x > t. Note that ut{x) = uo{x — t). The function ut{x) is 
called the point mass distribution at t, [S] . Note that ut (x) is always continuous 
on the right. 

A function that can be represented in the form tt; u^, {x) where is a 
countable set of real numbers, with ^ ^„ ii I ^ n, and where vr; > for 
every I and X); ~ called a discrete distribution function. Note that this 
function is well defined as a distribution function since it satisfies the previously 
mentioned properties. The corresponding random variable takes the value 
with probability tt;, and for a value a; such that x ^ VZ, it takes such a value 
with probability 0. 

A first result, see theorem 1.2.3, [S], is that every distribution function can 
be written as the convex combination of a discrete and a continuous distribution 
functions. Such a decomposition is unique. That is, the distribution function 
Fxix) may be decomposed as: Fxix) = p F^ix) + {I — p) F^ix), with < 
p < 1, where F^{x) and F^{x) are respectively, the corresponding discrete and 
continuous distribution functions. As for F^{x), since it is a bounded non- 
increasing function, then, it has non-negative derivative almost everywhere, but 
not necessarily this function is the integral of its derivative. 

Define, [5], a function F : R ^ IR as absolutely continuous in (— cxd, +oo) 
with respect to the Lebesgue measure A, (i. e. X{(x,x')) = x' ^ x, so that 
X{dt) = dt), iff there exists a function / in L^{R,£§, X), such that for every 

X < x': F[x')~F{x) — f{t) dt. Hence, an absolutely continuous distribution 
function F^{x) is the integral of its derivative, which exists almost everywhere 
with respect to the Lebesgue measure A, i. e. A-ae. That derivative is defined 
as the probability density function of the random variable X and will be denoted 
a,sp'^{x), so that F^{x) = J_rx.Pxi^) and p'^{x) = dF^{x)/dx, A-ae. 

Define, [6], a distribution function _F : IR — > IR as singular iff it is not iden- 
tically zero and F' exists and equals zero A-ae, i. e. almost everywhere with 
respect to Lebesgue measure. 

The main result is theorem 1.3.2, [5]: every distribution function can be 
written as the convex combination of a discrete, a singular continuous, and 
an absolutely continuous distribution functions. This decomposition is unique. 
That is Fxix) = pi F^(x) + p2 F^{x) + F^{x), with < < 1, for 
i = 1,2,3, and J2'f=iPi = 1; where F^{x), F^{x), and F^{x) are respectively, 
discrete, continuous, and singular continuous distribution functions. 

Another basic important result, is given by theorem 3.2.2 , [5], see also |16J, 
[6], [13]. That is, let the random variable X on ^) induce the probability 

space (IR, ^,px), and let / : R ^ R be Borel measurable, then: 



provided that any of these integrals exists. Note that these integrals are different 
in nature: the first is a Lebesgue integral defined over the space the 




INRIA 



Mixed States MRF's 



7 



second is a Lebesgue integral defined over the space (R, fJ-x), while the third 
is a Lebesgue-Stieljes integral in the real line. 

Let s be a statement taking the values TRUE or FALSE. Define the 
function taking real values l(s) as l(s) = 1 if s = TRUE, while l(s) = if 
s = FALSE. For a given set B C R, define Isix) = l{x 6 B), i. e. Isix) 
is the characteristic or indicator function of the set B. Abusing notation put 
l{(a;) for l^^j{x) if ^ is an isolated point. Define 113(2:) = 1 — tsix) and put 
llix) for 

Let B € and take f{x) = in the previous result, then: 

tB{x)fJ.x{dx) = / fix{dx) ^ fix{B) = / Isdi^xCa:)- 

JB J -00 

This, together with the definition of the distribution function, shows that there 
is a one to one correspondence between the induced measure and the distribution 
function for a given random variable. 

Call a discrete random variable, a random variable whose distribution func- 
tion is discrete, and call absolutely continuous random variable, a random vari- 
able whose distribution function is absolutely continuous. 

For the cases considered here, let's assume that the random variable X has no 
singular component, that is, the distribution function of the random variable X 
is a convex combination of a discrete and an absolutely continuous (with respect 
to Lebesgue measure) distribution functions. Call such a random variable a real 
mixed states random variable. Hence, the distribution function F^ of a real 
mixed states random variable, has the form: F^{x) = p F'^{x)-\-{l— p) F^ (x) — 
p J2i'^i ^?i(^) + (1 ~ P) I-ooPx(^) witi^ < p < 1. It is readily checked 
that the induced measure by the real mixed states random variable X, has 
the form: p^J^B) = p Y^i^ 1b(6) + (1 - p) p\{t) dt, for each B 

In [15j there is a study on the decomposition of the distribution function 
of real random variables in R". In particular it is shown that discontinuities 
in the distribution function occur in planes parallel to the axes. The nature of 
discontinuities in R" , is far more complicated due to the possibility of probability 
mass concentration in hyper-volumes of dimension less than n. It may happen 
that there is mass concentration in curves, surfaces, volumes, or hyper-volumes 
of dimension less than n, which are not presently discussed here. 



2.3 Probability density function 

Here, the probability density for a real mixed states random variable will be 
analyzed. As previously discussed, when a random variable X has an abso- 
lutely continuous distribution function, then such a function is the integral 
of its derivative, which exists A-ae. In such a case the derivative is called 
the probability density Junction. For a real mixed states random variable, 
its distribution function is a convex combination of a discrete and an abso- 
lutely continuous distribution functions with respect to the Lebesgue measure: 
Fjp(x) = p F^{x) + {l-p) F^ix) =pY.i^i u^Ax) + (1 " p) Il^Pxit) dt, 
with 0<p<l. If/9>0, then the distribution function F^{x) is not absolutely 
continuous with respect to the Lebesgue measure and then a probability density 
can not be defined. In this case two possible directions may be taken. 

A first direction would be to consider a generalized probability density func- 
tion Px{x) in the distributional sense, [53], 0, loosely in the form: Px{x) = 
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p TT/ 5{x — ^i) + (1 — p) Pxi^): < p < 1, where 6{x) is the Dirac delta 
"function" centered at x = 0, tt; is the probabiUty mass at x = and p'^{x) 
is the probabiUty density of an absolutely continuous distribution function 
with respect to Lebesgue measure. Loosely one has 1b(0) = JgS{x)dx, and 
Ua{x) = uq{x — a) ~ Jlao ^{^ ~ o,) dt- is well known the Dirac "function" 
5{x) is not a function in the ordinary sense, so that necessarily such an approach 
should be formally based on the theory of distributions, in either the view of 
[23] , or the view of [9] . This approach may also be loosely viewed as a mixture of 
a discrete and a continuous random variable. As a matter of fact, this intuitive 
approach was taken in [7 , considering the previous distributional density as the 
limit of a mixture of Gaussian random variables, one centered at zero with a a 
fixed very low variance co, i. e. very small with respect to the variance of the 
second Gaussian component, so that the first Gaussian component could loosely 
be interpreted as a Dirac delta function. In [5], [7] Markov Random Fields with 
mixed states random variables were used, where there appears a number of tech- 
nical problems when dealing with the Dirac delta generalized function. In [7] 
to circumvent those difficulties and give a rather intuitive presentation of the 
theory, a mixture of Gaussian random variables was used to give a feeling of the 
results. Formalizing the distributional approach seems too complicated when 
dealing with mixed states Markov Random Fields, so that to formalize these 
models a measure theoretic approach is proposed. 

2.4 Measure theoretic approach 

As previously discussed, the second approach is measure theoretic. A formal 
approach is presented next, and theoretical results are given regarding the struc- 
ture of real mixed states random variables, as to obtain general results that 
permit to construct models using these variables, such as those previously dis- 
cussed in [2], [7], [S], dU, [H], [5T], as well as other estimation, classification, 
segmentation, detection, and filtering problems in more complicated situations 
presently under study. 

Recall that a measure v is absolutely continuous with respect to a measure 
C both for the same measurable space, if for all measurable subsets B such that 
C(S) it is v{B) = 0. 

Call a measure of the form v{B) = Ci l_B(c?i) with q > for the mea- 
surable space (IR,=^), a discrete measure, whether X^i^i, is finite or not, and 
a measure of the form v{B) = Jg g dX, with g : R ^ R a fixed non-negative 
measurable function, g > 0, A-ae, an absolutely continuous measure with re- 
spect to the Lebesgue measure A, whether the integral is finite or not. Let 
/ : IR ^ IR be an arbitrary non-negative measurable function, then, if is a 
discrete measure: / fdv ~ J2i while if is absolutely continuous w.r.t. 

A it is: J f dv = J f g dX. Also, if ly is of the form i/ — i''^ + v"" , where 
u''- and v"^ are respectively discrete and absolutely continuous w.r.t. A, then: 
j f dv = X),; f{di) + J f g dX. It follows that this result is also true for 
f&L\R,^,iy). 

Recall that a real mixed states random variable, is defined as a random 
variable with distribution function F^{x) — p F^{x) + {1 ~ p) F^{x). 
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As previously discussed the induced measure generated by a real mixed states 
random variable X takes the form: 



I 



B 



for each B d where both /i^ and are probability measures. Hence, 

the Lebesgue integral of a non-negative measurable function / : IR ^ IR with 

respect to the measure space (IR,.^,^x) is: / f{t) iJ-^^dt) — p J2i^i + 

P) Ir fit) Pxit) dt. It follows that this result is also true for / G L^(IR, pj^). 

Let's introduce the measure m{B), for each B G for the measurable space 
(R,^) as: 

m{B) = V 1b{Ci) + f dx^ m\B) + A(S), (2) 

for each B £ where X{B) is the Lebesgue measure of B, and m'^ is the 
discrete measure m'^{B) = X)i 

Next, let's show that the induced measure ^'^ is absolutely continuous with 
respect to the measure to, that is fj,x << m. The result to be proved is that if for 
B G ^ it is m{B) = 0, then ^^(B) = 0. Suppose B G ^ is such that m{B) ^ 0, 
then 1b{£,i) = 0, for each I, so that ^/ ^ B, for each /, and then J^i ""(15(6) = 0- 
Also, since m{B) — 0, then X{B) — 0, but then, JgPxit) dt = 0. Combining 
these two results = is obtained. 

Given the probability space {^,J-,J3^), the mixed states random variable 
X induces the probability space {R,3§, p,x)- The main idea is to consider the 
measure space (R, to) instead of the standard Borel measure space (R, A). 
The main point is that when the probability space (R, p,x), is referred with 
respect to the measure space {R,^,ni), using the Radon-Nikodym theorem, 
[13j . a generalized probability density function may be defined, that permits to 
handle simultaneously discrete and continuous valued random variables. 

The version of the Radon-Nikodym theorem used here is, |i3j: let z/ be a 
finite measure on the measurable space (R,.^), and ^ be a tr-finite measure 
for the same measurable space (R,^), then, if i/ << i. e. v is absolutely 
continuous with respect to then, there exists a non-negative measurable C-ae 
function g : R — > R, such that for all B G it is = j^g dC,. Note that 

the function g is unique C,-a.e. 



Also, if v{B) = Jj^g d( is true for aU B e ^, then, [13], if / 



IS 



any non-negative z^-ae measurable function, or / G i^(R, v), then: J f diy — 

IfgdC 

Call A the countable set of all the i^/'s, i. e. A = : Z G N}, and call 
Ijj (a:) the point mass probability at 

Next, apply the Radon-Nikodym theorem to the induced measure fixi which 
is absolutely continuous with respect to the previously introduced measure to. 
Let's check that the Radon-Nikodym derivative is: 



-^^p^ix)=pJ2ni le, ix) + {1-P) rAix) P\{x). (3) 

To prove this result let's calculate, see equation 0: 

/ p^dm= [ dm'^ + f Px dX. (4) 
Jb Jb j b 
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For the first integral: 

JB JB I 

For the first term, JgJ2i'^i lCi(^) Tn'^{dx) = / IbIx) J2i^i ^Ci (^) Tn'^{dx) = 
Ej ^b{S.3) = since = 1 if = ^j, and 

= if 6 7^ As for the second term: 

J 1a W W ^'^(rfa;) = J M^) ^*Aix) Pxix) m\dx) 

since t*A{S,i) = 0, for aU ? e N. Hence, /^p^ dm'^ ^ P Y.i'^i ^b{^i)- 
For the second integral in equation ([¥]): 

/ p^Jl dX^ [ {pJ2n + (1 - p) p-kix)) dx 

JB JB I 

= pE^' / hii^) dx + (1 - p) I r^x) p^xix) dx, 

I JB JB 

applying Tonelli. But A(^/) = 0, for I = 1,2,---, since a single point has 
Lebesgue measure zero, hence the first term is zero. As for the second term, 
since X{A) — 0, because A is a countable collection of points, then: 

/ t*A{x) p^xix) dx^ p^xix) dx, 

J B JB 

so that /g Px dX — (1 — jo) Px{x) dx. Collecting all these results one obtains: 
J^p^ dm = p Ei^/lste) + (1 - P) IsPxi^) dx = fi^iB), for aU B e ^, 
which is the desired result, see equation ([1]). 

2.5 Label-real mixed states random variables 

The label-real mixed states random variables are defined as to consider proba- 
bility mass concentrated either in symbolic labels, as well as values in R" when 
these values belong to at most a countable subset of R" . If this is the case, all 
those values will belong to the set L. Let L = {^1,^2, • ' • } be a countable set 
of symbolic labels and eventually at most a countable number of values in R". 
Define the mixed states space as M = L U R", with n > 1. Define M as the 
collections of subsets of IM, such that A4 = 2"- U .^(R"), where 2"-, is the power 
set of L, i. e. the collection of all the subsets of L, and £§{R^) is the Borel 
cr-algebra for R", i. e. the minimal cr-algebra generated by, say, the open sets of 
R". Redefine A as the Lebesgue measure for (R", ,^(R")), i. e. the measure that 
assigns to a hyper-cube in R" its volume, given by the product of the length of 
the sides of the hyper-cube, so that A((ix) = dx. 

If M C M, define C(M), the complement of M as the set C(M) = M \ M, i. 
e. the elements in IM not in M. Note that any set M S Ai, can be decomposed 
as M ^ DU B, with D e 2"- and B e ^(R"). Such decomposition is unique if 
= 2°- n ^(R"), i. e. the set L consists only of symbolic labels. 
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Clearly is a a-algebra since: i) G A4, ii) if il/ G A^, then there exists 
D e 2'L and B e ^(R"), with = DnB and = BnL, such that M = DUB, 
so that C(B) = (L \ £)) U (R" \ B), and then C(A/) e M, iii) if {M^jiew is a 
countable sequence of sets Mi G A^, i = 1,2,- ••, then there exist Di G 2"-, 
and B, G ^(R"), i = 1, 2, • • • , such that = A U S^, i = 1, 2, • • • , but since 
U^ewA e 2^^ and U^gw-Bi G ^(R"), then M e M. 

Hence, a measurable space (IM,7V() was constructed. Following [5.J, given the 
probability space {^,!F, define the function X : — > IM as a mixed states 
random variable if X~^(M) G J^, for all M G A^, i. e. the inverse image under 
X of any set in the cr-algebra A4 is in the cr-algebra T. 

The main idea now, is to construct an induced measure /x^ for the random 
variable X in the measurable space (IM,At). Since now symbolic labels are 
present, which may not have any algebraic structure, a distribution function 
can not be defined to characterize the random variable. Hence, a possibility 
is to proceed directly to define the measure ^^{M), for each M G Ai, as, see 
equation ([T]): 

I Jm\l (5) 

= p/.i(M) + (l-p)/i^(M), 

where fii{M) = 2, tt, tniii) and fi'^{M) = /j^^^^p^(x) dx, with < p < 1, 
< TT/ < 1, ^ 1, 2, • • • , TT; = 1, and Px(^)' probability density with 
respect to Lebesgue measure of some real multidimensional standard random 
variable. Note that fJ,^{M) — 1, so that is a probability space. 

Also, note that Jj^j^^p^{x) dx = /m\l^'x ^ standard Lebesgue integral 

in (R",^(R")), since the integral is evaluated in the set M \ L C R", with 
M\L G i^(R"). 

Clearly if p > then /i^ is not absolutely continuous with respect to the 
Lebesgue measure. Following the same procedure as before, redefine the refer- 
ence measure m for the measurable space (IM, A^) as, see equation ([5]): 

m(M) = VlAf(^0 + / dx = m'^{M) + X{M), (6) 
J Jm\l 

for each M £ Ai, where now m'^ is the discrete measure m'^{M) = J^i 1m (^i) 
and where X(M) — /^^^[_ dx. Note that A(Af) is not the Lebesgue measure of 

M, since M ^ ^(R") in general, but is close in the sense that A(M) = A(M) 
if M G =^(R"), because, since A(M) = A(M \ L), and M C R" has at most 
a countable number of elements in L which have Lebesgue measure zero, then 
A(M \ L) = A(M), so that A(M) = A(A/). 

Also, Jj^j f dX ^ Im\l ^ non-negative measurable /, and then for 

all / G A). To show this result, start first, as usual, with characteristic 

functions. Hence, let / = 1m, with M G A1. Then, / 1m d~X = X{M) = 
dX = /||^„^||_1m dX. Next, [B], [TU], [13], proceed to simple functions, 
and then to non-negative functions using the monotone convergence theorem 
on both sides of the equality. Finally, the result for / non-negative, or for 
/ G L^(IM,A1,A), is obtained as J f dX — dX. Hence for non-negative 
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measurable /, or for / e L^{\S^, M,X), and arbitrary M G M: / 1m f dX — 
f dX, SO that J^,^ f dX^ / dX. 

As before, let's proceed to show that /i^ absolutely continuous with respect 
to m, i. e. /ix « 1^ = 0, then dx = and J2i ^Mi^i) = 0. 

Hence, Iniii) = 0, for Z = 1, 2, • • ■ , so that ^ M, for / = 1,2,- ■•, hence 
= M n L, and then M\L^ M, and Af G ^(R"). Then J^^^^ dx = /^^ dx = 
A(M) = 0. Hence M is Borel measurable, and has Lebesgue measure zero, so 
that /j/\[lPx(x) dx = PxW c^x = 0. Also, since ^ M, for Z = 1, 2, • ■ • , 
then J2i iM(^i) = 0, so that iJ^{M) = 0. 

Hence, since m is a cr-finite measure, and /i^ is a finite measure, as a matter 
of fact a probability measure, consider, as it was previously done, the Radon- 
Nikodym formalism, [T3]. As in the previous section, let's check that the Radon- 
Nikodym derivative is, see equation ([3]): 

^ ^ p^(x) = p ^ TT, 1,, (x) + {l-p) l^(x) p^(u;(x)), (7) 

where the function it; : IM — * R" is such that w(x) = x if x ^ L, while w{x.) = xr 
if X G L, where xr G R" is a fixed value in the domain of the function p^. Note 
that which value is chosen for xr is of no importance, as long as is a valid value 
for because of the factor 1l(x) = if x G L, resulting that the value of the 
second term in equation ([7]) is not altered by the choice xr. 

To prove the result given by equation ([7]) let's calculate, see equation 

j p'ldm^ j p^dm'^+ [ p^dX. (8) 
Jm Jm Jm 

For the first integral: 

p^dm^^ [ lpJ2ni le, (x) + {1 - p) l^(x) p^(«;(x)) ) m'^(dx). 

IM -^^J \ I I 

For the first term: 

/ ^vr; l£,(x) m'^idx) = \ 1m (x) ^ tt, l£,(x) m''(dx) 
Jm I J I 

j I. j 

since l^, (^j) = 1 if £; = Ij, and li^{£j) = if ^; 7^ £j. As for the second term: 

1* (x) p^{w{x.)) m\dx) = / 1m(x) 1^(x) p^(u)(x)) m''(dx) 

M J 

= 5]lAf(^/)lL(^i)Px(xR) = 0, 

since = 0, for all I G L. Hence, /^p^ dm'^ = P E; lAf(^i)- 

For the second integral in equation ([8]): 



/ ptdX^ I p^ dX 
Jm Jm\l 

f {pY.^1 li, (x) + {l-p) l^(x) p^(w(x))) dx 

J M\l. I 
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l,,(x)dx+(l-p) / l*(x)p^(u;(x))d: 



;x. 



J\/\L 



JM\L 



applying Tonelli. The first term is zero since for each / = 1, 2, • • • , it is 1^, (x) = 
0, for x 6 M \ L. As for the second term, since 1^(2;) = 1, for x G 7\f \ L, and 
since w{x.) = x for x S M \ L, then: 



so that J]^,jPx dX = (1 — p) Jj^^^p^{x) dx. CoUecting all these results one 
obtains: J^Px dm = p Y.i T^i'^nik) + (1 - p) j j^j-^^p^{:x) dx = p^iB), for all 
B e ^(R"), which is the desired result, see equation 

3 Real Mixed States Markov Random Fields 

3.1 Some definitions 

Let (IR^,^(IR")) be the measurable space where the space is R^, and ^(R") 
is the (T-algebra generated say, by the open sets in R^. Let A be a finite set. 
Define as the number of elements in A. Consider now the following spaces 

where for each i, each space Vi might be a discrete space, or R, or R"' 
or C"S for some rii > 1, or the union of a discrete space and C"' or R"', i. 
e. a mixed states variable. Here, each Vi will be considered as the union of 
a single discrete value, where probability mass will be concentrated, and R"' , 
with eventually a different dimension Ui for each i. Let A'^ be a finite positive 
integer and define V = Vi x 1)2 x ■ ■ ■ x Vm- Let / denote a function from T) 
to R. The function / is a function with N arguments (called also "sites") for 
which the ?-th argument takes values x^ G Vi. 

Let r G 2? be a fixed vector such that /(r) — 0. Call that vector a reference 
vector, or "ground" vector. Each G Vi will be called the "ground" value of 
the i-ih argument. Equivalently, let's say that the i-th component of a vector 
X G 2? is "grounded" if x^ = r^. 

Let S be the set = {1, 2, • • ■ , N}. For a given A <Z S define x^i as a vector 
built as the concatenation of the vectors x^ for i ^ A. The superscript when 
applied to a set, denotes the set complementing operation. In this section set 
complementing is considered with respect to the set S. 

Define x^ as a vector built as the concatenation of all the Xj for j ^ i, i.e. 
the vector x^ does not contain x^. Note that x? = Xjjjc 

For a given ACS define gA (x) as a vector of the same dimension as x such 
that the z-th component is [^^^(x)]^ — Xi ii i € A while [^^(x)]^ — ii i ^ A. 
That is, the values corresponding to sub- indexes in A are preserved while those 
corresponding to sub-indexes not in A are "grounded". Call the function (7a (x) 
the "grounding" function. 

3.2 The Hammersley-Cfifford Theorem 

Theorem 3.1 ([Ij) Let f be a function from V to any arbitrary group. In par- 
ticular, that group may be taken as R", for some n > I. Call = {1, 2, • • • , N}. 
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Given r G 2? such that /(r) — 0, then there is a decomposition: 

/(x) /■^(xa) (9) 

ACS 

satisfying: 

A) Each /yi(xyi) is a function that only depends on the arguments whose sub- 
indexes belong to the set A, ordered lexicographically, both, the sub-indexes in A 
and the arguments in f , so that there is a one to one correspondence between 
the elements of A and the arguments of f . That is, any change in the value of 
an argument not in A does not alter the value of fAi^A) ■ 

B) If for at least some i G A it is Xi = Vi, then /yi(x^) = 

C) For the given r, the decomposition given in equation ([9]) is unique. 

Note that as for the function / from V to Q, it is only required that Q has a 
group structure, i. e. the existence of a binary operation with group structure. 

Theorem 3.2 (Hammersley-Clifford theorem, [1], |14p Let p(x) be 
a generalized probability density with respect to some measure m, such that 
p(x) 7^ 0, Vx G v. Fix r G V, then, there exists a unique collection of 
functions Qa{^a) which take the zero value if any of its arguments is grounded, 
such that: 



log 



p{y) 



^ (3a(xa) 



(10) 



ACS 



log 



P(x»|x^) 
P(ri|x-) 



{i}CACS 



(11) 



4 A Decomposition Theorem 
4.1 Preliminaries 

In this section real mixed states Markov Random Fields will be considered. 
Following Chapter VI, [13], define the product measurable space {T>,Ai), where 
V is the cartesian product D = Vi XV2 ■ ■ ■'Dn, and Ai is the product cr-algebra 
generated by A^i x M2 x ■ ■ ■ x Mn- Consider the probability space (P, A^, m), 
where the measure m is given by 

N 

m = Y\_'mi, (12) 

for rectangles, where each measure is of the form m.^ = 1^- + Xi, where 
Ti e IR"', and where Xi is the Lebesgue measure for the measurable space 
(R"' , .^^(IR"' ). Note that m{V) = 1. Formalizing the product space is a rather 
long issue. As said in [13], p. 379: "The subject exhibits several technicalities, 
which can be an annoyance or a source of fascination: depending upon one's 
point of view" . Though this author belongs to the second group, the reader is 
referred to Chapter VI, [T3] , to raise the point on the construction of the prod- 
uct space. It can be checked that there are no surprises and that equivalent 
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results are obtained for the real mixed states random fields introduced here. In 
particular both Tonelli's and Fubini's theorems are valid. Define as usual, the 
marginal densities and the conditional densities. 

Define a real mixed states random field, as a collection of random variables X 
described by a joint generalized probability density function (x) with respect 
to the measure m = Yl^^i rrii. Note that the the function Px(x) is a function 
from 2? — > IR that integrates to 1 with respect to the measure m. Following 
[14j . define a real mixed states Markov random field, denoted as ms-MRF, a real 
mixed states random field such that p^{x.) ^ 0, for all x G T>. 

In what follows drop the sub- index denoting the random variable X inpx(x) 
and denote it as p™(x) , whenever there is no confusion in notation. 

Let p'"(xi I x^) be a collection, for i = 1,2, ■ ■ ■ , N, oi conditional probabil- 
ity density functions corresponding to random variables taking mixed values, i.e. 
pdf's with respect to the measures mi{d'x.i) — d{'K.i -|-Wr. (x^)), where Uj.^{'x.i) is a 
step function at x^ = r^, as previously defined. Random variables whose pdf's 
are taken with respect to these measures rui, will be called real mixed states 
random variables and the corresponding densities will be called ms-pdf 's (mixed 
states probability density functions). Whenever a ms-pdf is integrated, it will 
be done using a Lcbesgue-Stieljes integral with respect to the corresponding 
measure d(xi -I- Uri(xi)) as previously discussed. 

Recall: 

I 1 if X.i = Yi, 
lr.(x.) - „ , ' (13) 

if Xi ^ Yi, 



and: 

Define: 

and: 



i;^(x,:) =1- lr.(x.) . (14) 
(x^ = ^(x, = r, I x9, (15) 
p* (x^) = 1 - p. (x^) . (16) 



In this section let's determine the joint probability density function for which 
the conditional ms-pdf's with respect to the measures rui take the form: 

P™(X, |X^) = p,(x^) lr.(x.) + pli^ i:^(x,) (X,; I X,^) , 

Vi = 1,2--- ,7V. ^ ' 

These conditional pdf's can not be taken arbitrarily, except when they are all 
independent, because they have to satisfy the Hammersley-Clifford theorem in 
the form of theorem 13.21 in the previous section. When the x^'s are all inde- 
pendent, the conditional ms-pdf's may be taken arbitrarily. For this case the 
ms-pdf is simply the product of all the conditional ms-pdf's. Additionally, the 
Pi (x^) 's with Q < Pi (x^) < 1, and the functions p"^ (x^ | x^) = p°-{xi), may 
all be taken functionally independent from one another, in that case. 

When the conditional ms-pdf's effectively depend on the neighbors, there 
appear additional constraints that these functions must satisfy because of the 
Hammersley-Clifford theorem. 
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4.2 The theorem 



Let's say that p'^(x) is a MRF by itself ii it has the form given by equations 
([TUl) . pip satisfying theorem 13. 2[ so that the Markov Random Field is given by 
p°(x) , which corresponds to the pdf of some continuous distribution function 
with respect to Lebesgue measure. That is, if p"(x) is considered alone, as a 
pdf with respect to Lebesgue measure, then p°'{x) is a MRF. 

Theorem 4.1 If p'^{-x) is by itself a Markov random field with respect to the 
Lebesgue measure for (IR^,^(IR")), then, the potentials of the Gibhs represen- 
tation, 114-h of the joint ms-pdf decompose in a discrete related part and a 
continuous related part, from which all the conditions and constraints required 
by the Hammersley- Clifford theorem are obtained. 

Proof. From equation (fT7|l : 

log p'"(x, I X^) = lr.(x.) l0gp.(xD + 1:.(X.) l0gp*(x^) 

+ i:,(x,) log (x, I x,^) 

= lr.(x,) l0gp,(x,= ) + i:^(x,) logp*(x^) 

+ i:^(x,) log ^It^l'Si + Ki^^) log p'^(r, I X?) 
P v^i I Xj ) 

= lr.(x,) l0gp,(x,= ) + i:.(xO logp*(x^) 



The last equality is true since log pa^^' [ ^^j is zero for x^ = r^, and 1*. (x.;) 
1 for Xi ^ Vi. 

Also, since p'^(x) is a MRF by itself: 



(18) 



A<ZS 



(19) 



where to conform with the usual terminology, jl4j. l^"(x) is called the energy 
of the MRF, and {Q'Xi^A)} Acs is the collection of the potentials of the MRF, 
and: 

i"g !il!^'g^ = E QAi^-)- (20) 

P I XJ {^}CACS 



Hence: 



logp™(x, |XD = lr,(x,) log p,(xn 

+ e(x,0 log(p*(x?) p'^(r, |x?)) + 



E < 

{i}CACS 



?a(xa) 



(21) 



For Xi = Ti use ((T5| and (fTOl) to obtain: 

log /"(r, I X?) = log p., (x,= 

so that: 



(22) 



log 



P"(x, I x,^) 
p™(r, 1 x^^) 



i;(xO log 



p: (x^ 

A (x^ 



+ log 



(x. I x^) 



p^-ivi I x=) 



(23) 
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Apply theorem 13.21 to p™ (x) to obtain: 



(24) 



ACS 



where, as before, y"(x) is the energy of the mixed states MRF, and the col- 
lection {Q™(xyi)}yics is the collection of potentials of the mixed states MRF, 
and: 



p™(Xi I X^) \ - „jn/ \ 

p-ir, I X-) = ^ 



Applying (UHl) and ^ in ([121) i* results: 



Qa(xa) = i;.(xO log 

{i}CACS 



CaU: 



and define 



so that: 



ai = loe 



9^i^^) = log 



(25) 

E Qa(xa). 

{i}CACS 

(26) 
(27) 

(28) 
(29) 



Observe that for each ?, each function gi(x,J) may eventually depend on all 
the variables except the variable x^. Because of the N equations ((29l) . apply 
theorem 13. II to each of the N functions in ([^5]) for i = 1, 2, • • • , iV, to obtain: 



fl.(x^) = E for « = 1,2,-.. ,7V. 

ACS\{'i} 



(30) 



Hence: 



E q:?(x^) = i:^(x,o a.+ i:,(x,) ^ 

{i}CACS ACS\{i} 

+ E Qa(xa), for i = l,2,--- ,iV. 

4.2.1 First order cliques 

The first order cliques correspond to: 

A = {i}, for i = l,2,--- ,iV. 



(31) 



(32) 



Instead of x use the grounding function (7|i}(x), so that x^ = r^, in each of the 
TV equations given in ([31]), to obtain: 



g^lj(x,) = a,i:,(x,) + Q?,,j(xO, (33) 
Hence, all the first order cliques for the mixed states distribution were obtained. 
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4.2.2 Second order cliques 

The second order cliques correspond to: 

A = {i,j}, for l<i<j<N. (34) 

Subtract from (|3ip all the first order cliques obtained in Next, instead of 

X use the grounding function g^^ jy{x.), with i < j, to obtain: 

Q'/l^^.}(x,;,x,) = i:,(x,) (5;;\(x,) + g^,,,j(x„x,) ^^^^ 
= i:^(x,)(5g(x,) + g?,-,}(x,,xO. 

Hence: 

i;(x,)6;;'j(x,)= i:^.(x,)(5g(x,), VjV*, 1<^<J<A^. (36) 

Fix a value xj for x^ such that xj ^ r^, then i;^(xj) = 1. Call = ©^^^|(x|), 
then: 

(x,)=A,, i:^(x,). (37) 

Proceed analogously with x^ to obtain: — jdj^i 1*. (x,) . Hence, from 

i:^(x,) i;^.(x,)ft,, = i;^.(x,) i:^(x,)/3,-„ (38) 

so that: 

P^,3=PJ■^■ (39) 

Then, from ([35]) the second order cliques may be obtained as: 

Q'^",',^.}(x„x,)= i:^(xO i:^(x,) +Q|,_^.j(x„x,) (40) 

Hence, all the second order cliques for the mixed states distribution were ob- 
tained. 

4.2.3 Third and higher order cUques 

Proceed analogously for the higher order cliques. For clarity consider the third 
order cliques. The third order cliques correspond to sets of the form: 

A = {i, j, fc}, for 1 < i < j < fc < N. (41) 

Substract all the first and second order cliques from (I3ip using and ((30]). 
Next, instead of x use the grounding function j,i,(x), with i < j < k, in the 
j-th, j-th, and fc-th equations to obtain: 

x„ Xfe) = i;^ (x,) ©g^j(xj, Xfc) + Q^,^^,fc}(x„ Xj, Xfc) 

= i;^.(x,) (5g,j(x„xfe) + Q|^.,^fej(x„x„xfc) (42) 

= KS^k) ©5J^.}(x„x,) + Q^,_,^^.^(xfe,x„x,). 

Hence: 

i;^(x,) ©«,j(x„xfc) = i;^.(x,) ©;^|,j(x„x,) = i;^(xfe) ©;y^.j(x„x,), 

Vi, j, k such that l<i<j<k<N. 

(43) 
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Next, proceed as before fixing values diS^erent from the "ground" values for x^, 
Xj and x/j to obtain: 

(Sg,j(x,,xO = x^,J,k i;.(x,) i:jxfc) . (44) 

and: 

i:,(x,) i:^(x,) i:jxfe) x.,,,fc = i:,(x,) i;^(x,o i^^k) x,...k = ■ ■ ■ , (45) 

so that: 

(46) 

where perni(i. k) denotes an arbitrary permutation of the subindexes i, j, and 
k. Then, from ()42p the third order cliques may be obtained as: 



Q{l.,,fc}(x^-^j) - X^J,k i;,(x.) i;^.(x,) i;jxfe) +g^,^^,fc}(x,;,X,,Xfc) 

(47) 

Hence, all the third order cliques for the mixed states distribution were obtained. 
Proceed analogously to obtain all the higher order cliques. 

4.2.4 Joint distribution 

From the previous results the joint distribution may be obtained from the first, 
second and higher order cliques as obtained from ([33|) . (I40p . (j47|) and its exten- 
sions, as: 



^ [a,, i:,(xo i:^(x,) +Q|,^^.j(x„x,) 

<i,3> 

J2 [^^.J--^ KMi) K.i^j) K.M +Q^,,j-fc}(Xi,Xj,Xfc) 



<ij,k> 



(48) 



where 



N-l N 



E - E =EE = E E' 

l<i<j<iV 



and 



N-2 N-l N 

E - E -EEE-E E E • 

<i,j,k> fc}G2S i i k i=l k=j+l 

l<i<j<k<N 

Define: 

F'^(x) ^ Q'^(x) = ^ a,i:,(xO + J2 /^^J- 
i <hj> 

+ ^^^3'^ ^r.(x.) i:^(x,) i:,(xfe) +•••. 

<i,j,k> 



(49) 
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Hence, from (UH), (gH), and (gS]) it results: 

\og^^^ V^-Cx) = Vi^) + V^i^). (50) 

To further stress the presence of the parameters, call cj)^ a vector containing 
all the parameters of V'^{x.), see equation P^j) . Similarly call cp^ the vector 
containing all the parameters of y (x). Then, ([501) takes the form: 

log^^^ ^ y"(x;0„0J = ^^(x;^,) + V^'^(x;c/.J. (51) 

Define the partition functions: 

Z''{<t>a) = / e^"^''^'^") m(dx), (52) 



^'(0<i) - 1 c^'(-^<^<') m(rfx), (53) 

and: 

Z™(^,j,0J = /e^"(^'<^'''<^») m(dx) = /e^°('''<^'')+^'(''''^'') m(dx) (54) 



Define the generalized probability density function p'^(x; 0^) as: 

/(x;0,) = |— — , (55) 



so that: 



Similarly, from (fTO]) : 



Also, from ([5T|) and ([S; 



Z''(0d) = -TT^-rr- (56) 



= a/ ^ V (57) 
P"(r;0a) 



Z™(0„0J = „ . , (58) 



Collecting all these results in equation ([5T|) . it results: 



p™(x) = P°(x;</»J^ (59) 



where: 



^('^'^''^"^ ^ Z^^0J^Z?(ij ^ / P'^^''^'^) P"(^;'^a) m(dx), (60) 

is the normalization constant, depending only on the parameters, for the product 
This product should not be misinterpreted as any independence condition. 
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From (UHl), IHI), dSni), (133), (H) and its extensions: 



log 



i#*> j<k 



f).(xD- 



(61) 



Hence: 



(62) 



4.3 The converse 

Conversely: if a MRF has the form given by equations ([59|l and ([60|) . satisfying 
theorem 13. 2| where p''(x; (p^) is the pdf of an arbitrary absolutely continuous 
distribution function with respect to Lebesgue measure, that is p°'{n.]4'^) is 
a MRF by itself, i. e. satisfying equations 1^0]) and theorem 13. 2[ and, 

p'^(x;(/)^) is an arbitrary discrete random field given by equations (j55p . ()49p . 
and ([5^ . then, the conditional ms-pdf's have the form given by (fT7|) with the 
Pi (xf) 's given by ([62]) . where the ()i(x?)'s are obtained from ([6T|) using (|49|) . 
Proof. Assume the joint generalized probability density function with respect 
to the measure m given by equation (|12p is given by: 

gy"(x) ^V^i^) + T/'^(x) 
= ^ exp I ^ Q:^(x^) + 5] a. i:,(x,) + ^ A,, i;(x,;) i;.(x,) 

\ ACS j <ij> 

+ 51 ^^.j^^ ^r.(x.) i:^(x,) i:^(xfe) + . 

<i,j,k> 

(63) 

Note that p™(x) ^ 0, for all x G P. 

Let / G 5", since Px(x) = Xf (^^x^), then: 

p™, (xHxn P5^Vx?(xi,xn 

lOE ^ — log ^ = 

%™|xc(r,|xn P^„x^(r/,xn 
= 5] Ql(x^) + i:,(xO 

{/}CACS 

+ E ^r, (Xj) + 51 ^r, (X,) (Xfe) + , ^ 
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since Q'\{xa) = 0, for x; = r; if I e A, and where equation was used. 
Hence: 

= p^,|xe(rHxne5:o,c.c.Q^.(x.) (i^, (x,) + 1^, (x;) e'^'(^?)) 

= PxHXf(ri I x^ (lr,(xO + i;,(xO e'^'(^;) e^ws-s-'3^(''-*) 

(65) 

because J2{i}cacs QH^a) ^ 0' x; = r;. Substituting equation in 
it results: 

Ix.(x, Ix^^p™ |x.(rHxn (lr,(xO + 

ef'W) _ . , ..X (66) 



+ (Xi) ^r^^ Px, I X^ (Xi I xH 



Since / , yc(x; | x^) dmi = 1, and 

y"px, I x?(xi I xH drn, = ^p^^ , xe(x, | x^ dmf + j p'^^ , x.(x, | x^ dxj 
^Px, I x,^(i-i I x^ +/Px, I x,^(xi I x^ dxz, 

(67) 

then: 

1 - I xc (r; 1 xf ) + j 1 xc (x; I xn dx; . (68) 
From equation (j66p : 

™Px,ixf(xHxr) 



fx,|Xf(rHxn 



dx, 



lr,(xO'^x. + / '"' ^"' ' y i;,(x,)ef"W),x, (69) 
Px, I X- I X/ j 

lr,(x.)rfx.+ef''W) /l*(xO dx. 

Px, I X- y'^i I X; ) 

The first integral is zero since the integration set is a single point having 
Lebesgue measure zero, while the second integral is a standard Lebesgue in- 
tegral over the whole space except for a point of Lebesgue measure zero, so 
that: 

/ , x,(x, I xH rfx, . , x,(r. I xH e^' W) j ' ^^^^^^'^ '^^'^^ d^, 

' (70) 

But: 

j p^, I X. (Xi I xH d^i = 1, (71) 
so that, from equations ([TO)) , and (|7T|): 

l-P;,|x,(r,|x»(l + ^„ ;^g^.^ ). (72, 
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Call pii'X-i) = I x<=('"' I Pii'^i) — 1 ~ Pik^i)- Then, from equation 

Pii^i) = Px, I x^(r; I xH = ^\,(xn ■ (73) 

Using equation ([75]) in (15^ one obtains: 

Px, 1 x,4xi I x;=) - pKxz) lr,(xO + (1 - Pi(xn) i:,(xO I xe (x, I xj=) 

= PKxH lr,(xi) + pr(Xi) i:,(xO I xc (Xi I , 

(74) 

which is the desired result. 

5 Conclusions and Further Work 

A theoretical formulation of the mixed states random variable was presented, 
as well as a theoretical analysis for mixed states Markov Random Fields with 
probability mass concentrated in a real value. From the results obtained here, 
mainly equation (|63p which gives the joint ms-pdf with respect to the measure 
m, and equations ()73p and (|74p which give the conditional ms-pdf 's with respect 
to the measures m^, previous results given in [2], [7], [5], [TT], [12], [U], [IS] . 
[IS], [20], [2T], are immediately obtained. 

Equation (|63p permits to use the power of the Gibbs formulation using poten- 
tials to design the MRF, as an alternative to the use of conditional distributions 
as was done in [2], [7], [S], [TT], [H], [T7], [H], [H], [20], [H], [IS]. 

Results presented here will be extended in two directions. 

In a sequel, the extension of the results given here to Markov Random Fields 
of Mixed States variables which are mixtures of a denumerable set of probability 
mass concentrated in either label values and/or multidimensional real values, 
and a standard absolutely continuous distributed multidimensional real random 
variable will be given. 

The second direction corresponds to the analysis of Mixed States Markov 
Random Fields whose potentials present interaction between the " discrete" and 
the "absolutely continuous" distributed components of the mixtures for the 
potentials of the Gibbs formulation, which are presently under study. 
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